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BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 

IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 
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The present invention relates to processing of image data and in particular to 
enhancing quality and compressibility of digital images including combinations of 
text, graphics, and natural images by selective Smoothing/denoising and selective 
sharpening. ; 

BACKGROUND OF TfaE INVENTION 



Digital image data is often processed to enhance the visual quality of the 
image. Common image processing techniques include image smoothing and image 
sharpening. Smoothing is a technique that is njiainly performed for reducing certain 
types of noise. Non-selective (or linear) smoothing algorithms smooth all features in 
an image (i.e., areas in the image which can be; characterized as flat regions and areas 
within the image which can be characterized as edges). However, it is undesirable to 
smooth edges since smoothed edges gives the image a "blurry" appearance. 
Moreover, although smoothing is effective in removing most Gaussian noise, it is less 
effective in removing high amplitude noise sucjh as speckle noise. Speckle noise can 
be characterized as a single unintentional blaclj: dot in a white region or a single 
unintentional white dot in a black region. 



Generally, sharpening is a technique in 
sharpened to improve the visual quality of an 
performed to enhance the visual quality of text 
disadvantage of non-selective sharpening tecl 
noise. 



which the edges within the image are 
i|nage. This technique is often 

or graphics within an image. One 
hi|iiques is that they also tend to amplify 



to 



Selective (or non-linear) filters such as 
sharpening filters overcome the disadvantages 
filtering function only to the features that are 
preserving the non-selected features. Selectiv^ 
identifying or differentiating between features 
desired feature. One example of an edge 
anisotropic diffusion filter. 



selective smoothing or selective 
of non-selective filters by applying the 
be smoothed/sharpened while 
filters include some means of 
so that the filter is applied only to the 
, selective smoothing filter is an 



preserving 
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Due to its denoising nature, the anisotropic diffusion filtering technique has 

recently been considered for enhancing comprejssibility. Specifically, an anisotropic 

i 

diffusion filter was iteratively applied to imagejdata between 10 and 20 times to 
obtain an optimal ratio between a visual quality measure and the bit-per-pixel (bpp) 
compression rate. It was found that applying sliterations produced images that were 
perceptually equivalent to the original images 4nd the compression bit-rate was 
improved by 5%-17.5%. Although this technique shows that anisotropic diffusion can 
be used to improve image compressibility, it is j impractical for real-time image 
processing applications such as image scanning since many time consuming iterations 
are required to obtain the desired image quality and compressibility. In addition, the 
conventional anisotropic diffusion technique does not clean speckle noise and other 
types of high amplitude noise and is thus insuf: icient for pre-processing scanned 
document images. 

Another denoising/smoothing filtering echnique that has been suggested for 
compression enhancement applications is a Sigma-filter that is even more 
computationally expensive per iteration than anisotropic diffusion filtering (although 
it requires less iterations for achieving the same noise reduction). However, this 
technique is still not fast enough for applications for processing full-page images or 
real-time image processing. Like the anisotropic diffusion filter, the Sigma-filter also 
does not remove high amplitude noise. 

Finally, in the case of both denoising techniques (i.e., anisotropic diffusion 
filtering and Sigma pre-processing) each was qonsidered for processing only natural 
images. However, application of these techniques on document images containing 
text, graphics, and natural images was not considered since it is well known that 
denoising filters (particularly applied in many iterations) degrade the quality of textual 
and graphical images. Specifically, edge sharp ness of text features is degraded. 



30 



What is needed is an image processing 
combination-type (i.e., text, graphical, natural) 
compressibility while enhancing image quality 
real-time applications. 



technique which can be applied to 
document images and which increases 
with low computational complexity for 
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SUMMARY OF THE INVENTION 
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A system and method of enhancing image data and increasing 
compressibility of data by selectively smoothing the image data while 
preserving edges and selectively sharpening image data using variable contrast 
stretching. In one embodiment, variably contrast stretching is performed by 
clipping those pixel intensity values outside of a variable range and mapping 
those pixel intensity values within the variable range. In another embodiment, 
selective smoothing is performed using a robust anisotropic diffusion (RAD) 
filter. 



BRIEF DESCRIPTION O F THE DRAWINGS 



Fig. 1 illustrates a first embodiment of [the image processing method of the 
present invention; 



Fig. 2 illustrates an embodiment of the 



variable contrast stretching function; 



Fig. 3 illustrates a 3x3 hollow neighborhood; 



of the image processing method of the 
Fig. 5 illustrates a technique of applying the method shown in Fig. 4 to image 



Fig. 4 illustrates a second embodiment 
present invention; 



data; 



20 Fig. 6 illustrates another technique of applying the method shown in Fig. 4 to 

image data; 

Fig. 7 illustrates an embodiment of the 
present invention. 



system of image processing of the 
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DETAILED DESCRIPTION OF THE INVENTION 



In general, the present invention is an ijnage processing method and system for 
performing both selective image smoothing/de noising and selective image sharpening 

5 using variable contrast stretching such that when performing selective image 

smoothing, areas within the image characterize d as flat regions are smoothed/denoised 
while areas within the image characterized as edges are essentially preserved and 
when performing selective image sharpening using variable contrast stretching, edges 
within the image are sharpened without cancel ing out the smoothing/denoising effects 

10 on the flat regions obtained during selective smoothing and also without introducing 
overshoot noise at edges. Variable contrast stretching is performed by dynamically 
clipping pixel values which, besides sharpening, is also effective in removing speckle 
noise that is not removed during selective smoothing. 

The combination of denoising (i.e., noilse removing) obtained from selective 
15 smoothing and despeckling (i.e., speckle removing) obtained from selective 

sharpening results in significant noise reduction. Reducing image noise allows for 
increased compressibility. Hence, the system uid method of image processing of the 
present invention is particularly adaptable to pre-processing image data prior to 
compression so as to enhance image compressibility while maintaining or improving 
20 image quality. For example, in one compression method based on a bit-plane 

representation which applies lossless compression to a truncated set of bit planes as 
described in the application entitled "Method Including Lossless Compression of 
Luminance Channel and Lossy Compression cjf Chrominance Channels" (Attorney 
Docket No. 10006187-1) filed September 29, £000 and assigned to the assignee of the 
25 present invention, the compression ratio is increased in a range of approximately 30- 
50%. 

Since selective sharpening according to the present invention retains 
smoothing/denoising effects from the selective smoothing, the image can be initially 
oversmoothed during selective smoothing to obtain increased denoising and then 
30 selectively sharpened to re-sharpen edges that might have been affected by the 
smpothing algorithm thereby providing significant denoising capability. 
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The system and method of the present invention requires minimal computation 
steps since a single iteration of each of selective smoothing and sharpening techniques 
achieves acceptable image quality and compressibility. 

Fig. 1 shows a first generalized embodiment of the method of the present 
invention in which selective smoothing is performed using any edge preserving image 
smoothing/denoising technique (10) and selectively sharpening is performed on the 
selectively smoothed image data using variable contrast stretching (11). As shown, 
input image data I is coupled to the input of the selective smoothing stage which 
generates selectively smoothed image data I 1 Wherein areas within the image 
characterized as flat regions are smoothed/denpised and areas within the image 
characterized as edges are essentially preserved. The selectively smoothed data V as 
well as the original image data I is coupled to the selective sharpening stage. The 
smoothed image data I' is sharpened dependent on dynamic contrast information 
obtained from original image data I wherein edges are sharpened such that denoising 
benefits obtained while smoothing are unaffected. In one embodiment, the method of 
image processing is performed in a single iteration. 

Edge-preserving image smoothing/denjoising techniques can be performed by 
anisotropic-type diffusion filtering, non-linear smoothing/denoising filtering, bilateral- 
type filtering, Sigma filtering, order statistics filtering such as median filtering, or any 
other type of edge preserving smoothing filter In one type of edge-preserving 
smoothing filter, pixel data corresponding to ddges within the image data are 
identified and the smoothing filter function is applied to flat regions and is not applied 
to the identified edges. In general, linear smoothing is an operation where the pixel 
value is replaced by a weighted average of its neighbors. This attenuates high 
frequency components, namely abrupt change^ in pixel intensity. It should be 
understood that the degree of edge preserving jobtained when selectively smoothing is, 
in part, dependent on the reliability/robustnes^ of how edges are differentiated from 
flat regions by the edge preserving smoothing (filter and the strength of the smoothing 
filter. As a result, some edges may incur some smoothing. 
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Selective sharpening is performed using .variable contrast stretching. Selective 
sharpening using variable contrast stretching is described in an application entitled 
"Image Sharpening by Variable Contrast Stretching" (Attorney Docket No. 100063 10- 
1) filed September 29, 2000 and assigned to the assignee of the present invention. 
Variable contrast stretching reduces spatial sc41e of large gray-level transitions, 
resulting in considerable sharpening of featured in computer-generated images (e.g., 
text, CAD drawings). The variable contrast sketching only mildly reduces the spatial 
scale of milder gray-level transitions, resulting in a milder sharpening of features in 
"natural" images (e.g., photographed features, jfeatures captured by an image capture 
device). Thus, the variable contrast stretching! applies strong sharpening to computer- 
generated features and mild sharpening to edges in natural features. The variable 
contrast stretching improves the appearance ar d legibility of compound documents 
containing both natural and computer-generated features. However, the variable 
contrast stretching does not change the spatial 
and thus, does not amplify low amplitude noisp. 



scale for weak gray-level transitions, 



One of the advantages of the first embodiment of the method of image 
processing shown in Fig. 1 is that the step of selectively smoothing is effective in 
removing most noise types including Gaussiarj-type noise but is ineffective in 
removing speckle-type noise (e.g., white dots 6n black or black dots on white) since 
speckles often appear as edges to selective smoothing filters, while the selective 
sharpening step using variable contrast stretching is effective in removing the speckle- 
type noise. As a result, the system and method of image processing removes a 
significant amount of noise from the image. 



Removal of noise from image data 
image data. Accordingly, one application of 
present invention is the pre-processing of 
in Figures 1 and 4 prior to compressing the 



the 



imaj;e 
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It should be noted that the effectiveness 
what type of selective smoothing is performed 
stretching is adjusted for filtering certain types 



allojws for increased compressibility of the 
image processing method of the 
data according to the methods shown 
lmjage data. 



of the noise removal is dependent on 
as well as how the variable contrast 
of image data. Hence, the increased 
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compressibility is dependent on how effectively noise is removed when selectively 
smoothing and selectively sharpening using variable contrast stretching. 

Variable Contrast Stretching 

Selective sharpening of smoothed digital image data using variable contrast 
stretching is performed as follows. The smoothed digital image I' is made up of a 
plurality of selectively smoothed pixels P. Ea<j;h selectively smoothed pixel F 

i 

corresponds to an original pre-smoothed pixel P having the same location within the 
digital image. A point-wise contrast stretching operation g( • ) is performed on each 
selectively smoothed pixel of interest P 0 ' as follows in Eq. 1: 
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(Eq. 1) 



g(P 0 ) = 



P n - A< -W 



O o'-A\ 



<W 



P 0 -A>W 



m 

A + - 
M 



— (*'-*) 



Figure 2 illustrates the graphical representation of the variable contrast 
stretching function g(Po')- The pixel of interes : P 0 f is filtered with respect to a 
neighborhood of pixels. The neighborhood of pixels corresponds to the hollow (i.e., 
missing center pixel) neighborhood of the pre- smoothed pixels with respect to the pre- 
smoothed pixel of interest P 0 . Fig. 3 illustratds an example of a hollow neighborhood 
of pre-smoothed pixels. The hollow neighborhood, delineated by a window indicated 
in dashed lines, includes a 3x3 array of pixels minus a center pixel. The center pixel 
block designated by an "X", corresponds to the smoothed pixel of interest Po* to be 
operated on by the sharpening algorithm. 

Since the pre-smoothed neighborhood i s used, edges are sharpened dependent 
on pre-smoothed image dynamic contrast infoimation resulting in more reliable edge 
sharpening. The maximum gray- value of the r eighborhood is denoted by the 
uppercase letter M, and minimum gray- value c f the neighborhood is denoted by the 
lowercase letter m. The local dynamic range of the neighborhood, denoted by the 
letter D, is the difference between minimum aijid maximum values of the 
neighborhood (i.e., D=M-m). If, for example, ijhe pixel intensity values are 
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represented by 8-bit words, the lowest intensity value of the pixels in the 
neighborhood is m=5 and the highest intensity value of the pixels in the neighborhood 
is M=250, the dynamic range is D=245 for that neighborhood. 

A "contrast range" has a width of 2W. The contrast range is centered about 
5 the middle (A) of the dynamic range, A=(M+m)/2. Thus, the contrast range has a 
starting point at A-W and an ending point at A+W. 

If the intensity value of the pixel of interest P 0 ' is outside of the contrast range, 
the intensity value is clipped to either m or M. If the intensity value of the pixel of 
interest lies within the contrast range, the amount by which the local contrast is 
10 changed is determined by the gradient of the slope of a line segment 10 (Fig. 2) within 
the contrast range. 

The slope of the line segment 10 is a function of the dynamic range. In 
general, the slope, denoted by S(D), complies with the following: 

- the slope approaches unity as the dynamic range D approaches 0 (i.e., S— >1 
15 as D— 0); 

- the slope is greater than unity when tt^e dynamic range is greater than zero 
(i.e., S>1 when D#)); and j 

- the slope is a non-decreasing function of the dynamic range (i.e., as the 
dynamic range increases, the slope becomes larger and the sharpening increases). 

20 Thus the slope is a function of the dynamic range and the contrast range of a 

given pixel neighborhood. Because a neighborhood is determined for each pixel, the 
dynamic range, contrast range and the slope arje variable on a pixel-by-pixel basis. 

There are many different ways of expressing the slope of the line segment 10 
(Fig. 2). For example, the slope may be expressed as follows in Eq. 2: 

25 (Eq.2) 5(D) = — = 1 + — 

4 2W R 
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where constant R is a single global parameter that corresponds to the dynamic 
scale for sharpening. Thus, the variable contrast stretching operation within the 
variable contrast range may be expressed as follows in Eq. 3: 
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(Eq. 3) g(P 0 ') = Po + f (V -U] {|p o ' - a| < W} 

If D»R, the mapping becomes equivalent to toggle mapping, whereby edges 
are over-sharpened. Proper selection of the constant R prevents such a problem. For 
neighborhoods having small dynamic ranges, P«R and 1+D/R~1. Therefore, no 
effective change in contrast will occur for D«R. 

The constant R may be limited to powers of two for computational efficiency. 
Since the quantity 1+D/R involves a division by the constant R, limiting the constant 
R to a power of two allows the division to be performed simply by bit-shifting. Thus, 
R=2 L , where integer L>0. As the constant R decreases, the sharpening effect increases 
since the contrast region 2W is smaller and the slope S(D) of the contrast stretching 
becomes larger. 



For pixel intensity values that are re 
value of R is between 64 and 512 (i.e., 6<L<9\ 
of the entire image is normalized to cover the 
capturing device (e.g., scanner), the preferred 
dynamic range and twice the dynamic range. 



presented by 8-bit words, the preferred 
More generally, if the dynamic range 
complete dynamic range of the 
value of R is between one-quarter of the 



It should be noted that variable contrast stretching also avoids overshoot. 
Thus, over-shoot related artifacts do not appear as the result of interpolation of digital 
images that have been sharpened by variable contrast stretching. 

Variable contrast stretching does not enhance low-amplitude noise, and in 
some cases can slightly reduce low-amplitude noise. Because the variable contrast 
stretching does not increase low-amplitude nofse and it avoids overshoot, 
compressibility of the sharpened image is not j-educed. Consequently, a digital image 
may be sharpened only once, prior to compression, thus avoiding the need to sharpen 
the "image each time after decompression. 
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The variable contrast stretching is not limited to linear mapping within the 
contrast range. Although linear mapping is preferred, non-linear mapping within the 
contrast range may be performed. 

Fig. 4 shows a second embodiment of the method of image processing in 
5 which image data is initially selectively smoothed (12) using an edge preserving 

filtering technique known as Robust-Anisotroj>ic-Diffusion (RAD) filtering and then 
smoothed data is selectively sharpened using variable contrast stretching (13). 

The RAD filter is a type of filter that performs selective smoothing by 
simulating a diffusion process on the image w lere the diffusivity depends locally on 
10 the strength of a feature type, i.e., an edge. The selectivity mechanism is based on 

robust statistics and in particular to an influence function y/of a robust error-norm. In 
this embodiment, RAD filtering is applied in z single iteration to a 3x3 neighborhood 
(i.e., kernel) of each pixel of interest P 0 in the jnput image data I to generate a 
smoothed pixel P 0 '. 

15 For each pixel of interest, P 0 the following RAD filtering equation (Eq. 4) is 

applied: 



(Eq. 4) P 0 ' = P 0 +(A0XC^fc ~Po*t) 



where Pj is one of the neighbors in the hollow 3x3 neighborhood, y/ is the 
influence-function of a robust error-norm, T is a characteristic scale of y/ f the Cj are 

20 spatial weights, and At is an arbitrary time step for the diffusion filter. In this 

embodiment, the arbitrary time step At relates to a heat diffusion model parameter and 
is set to At =1 so as to provide adequate filter denoising and simplified computation. 
Other values of At may be selected. The parameter Cj provides a spatial weighting. 
In one embodiment, the Cj factors correspond |to a 3x3 binomial filter which is set as 

25 follows: 
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7 = 2,4,5,7 
7 = 1,3,6,8 



where subscript j corresponds to the pixel 
(shown in Figure 3) including the center pixel 



location within the 3x3 neighborhood 
of interest P 0 (not shown in Fig. 3). 



The influence function corresponds \o a photometric weighting function 
5 and, in this embodiment, is given by: 



y/(AP,r) = 



AP>T 

\AP\<T 

AP<-T 



T 
AP 

-r 



wherein AP is Pj-Po- The above i 
a good trade-off between denoising efficiency 
the preferred characteristic scale is selected as 
image is a document image including text, 



influence function is selected so as to provide 
and image quality. In one embodiment, 
T~32 in the case in which the input 
ics, and natural images. 



graph 

It should be noted that other influence functions may be used to perform RAD 
image filtering. Specific influence functions determine the degree of smoothing 
dependent on the pixel of interest and its neighborhood type. Hence, different 
functions may be chosen dependent on the type of input image data. 

The smoothed image data is selectively sharpened (13, Fig. 4) using variable 
contrast stretching as described above. Specifically, the input to the selectively 
sharpening filter is the output of the RAD filter, (i.e., the selectively smoothed image 
data, I 1 ). The selectively smoothed image dat^i is then selectively sharpened on a 
pixel-by-pixel basis. 

Two parameters, T and /?, used in the method of image processing as shown in 
Fig. 4 provide significant control over the amount of smoothing and sharpening 
obtained from the method and hence, also influence both image quality and 
compressibility. These values can be empirically selected so as to obtain the best 
compressibility while maintaining acceptable image quality which is, in turn, 
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dependent on the type of image (i.e.,.natural, graphical, textual, or a combination of 
these image types) being processed. 

For instance, as R is increased, image sharpening decreases and compression 
ratio slightly increases until it reaches a maximum value. So R may be set so as to 
5 obtain the most desirable visual sharpness and the most acceptable compression ratio. 
Similarly, as T increases so does the compress on ratio, however, so does image 
blurring. Hence, T may be set so as to obtain tpe most desirable visual smoothness 
with the most acceptable compression ratio. It was found that setting T=32 and 
R=128 yielded acceptable visual quality and significantly increased compressibility 
10 for document images including text compressed according to the compression method 
as described in the application entitled "Method Including Lossless Compression of 
Luminance Channel and Lossy Compression o|f Chrominance Channels" (Attorney 
Docket No. 10006187-1) filed September 29, $000 and assigned to the assignee of the 
present invention. 

15 In one embodiment, the selective smoothing and selective sharpening of the 

method of Fig. 4 can be combined into a singly in-lined pixel-by-pixel process. By 
combining the pixel processing steps of selective smoothing and selective sharpening, 
computation time is minimized by reducing the number of times data elements 
(intensity values, contrast values, etc) are accessed and processed. Fig. 5 shows one 

20 technique of applying the method shown in Fig. 4 in a single in-line process where 
image data is smoothed and then sharpened on a pixel-by-pixel basis. 

A digital image I in is accessed or received (block 102). The digital image may 
be accessed from a digital image file, the digital image may be received one or more 
lines at a time and processed in real time, etc. 

25 For each pixel of interest P 0 (block 104, 120, 122) from digital image data I in , 

a neighborhood of pixels is determined (block: 106), an influence function value y/ is 
determined for each pixel with respect to each pixel j in the neighborhood (block 
108), a weighting value Cj is determined for each pixel in the neighborhood (block 
1 10), and the RAD filter function (Eq. 4) is applied to the pixel of interest P 0 (block 

30 112) to generate a smoothed pixel of interest Ffo*. Next, the hollow neighborhood of 
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pixels is determined (block 1 14), adynamic range and contrast range of the hollow 
neighborhood are determined (block 1 16), and the contrast stretching operation g(Po') 
is applied to the pixel of interest P 0 * (block 1 18j) to generate a smoothed and sharpened 
pixel value P 0 ". Pixels lying at the boundaries pf the digital image will have partial 

5 neighborhoods. These boundary pixels may be processed with respect to their partial 
neighborhoods, or the filtering may be ignored land the boundary pixels may be stored 
without modification. After smoothing and sharpening each pixel, the resulting 
digital image data I out may be compressed (block 124). In the case in which the 
neighborhood size and geometry is the same for each of the smoothing and sharpening 

10 processing steps, then the step of determining tne neighborhood for the nth pixel 
(block 106) and the step of determining the hollow neighborhood for the nth pixel 
(block 1 14) can be performed in a single step by block 106. 

Fig. 6 shows an alternative embodiment: for applying the method as shown in 
Fig. 4 to a digital image in which image data I is smoothed to generate smoothed data 

15 I' and then the smoothed image data I' is sharpened to generate processed data I". A 
digital image is received (block 202), and for each pixel of interest (block 204, 214, 
216) from digital image data I, a neighborhood! of pixels is determined (block 206), an 
influence function value y/ is determined for each pixel with respect to each pixel j in 
the neighborhood (block 208), a weighting value Cj is determined for each pixel in the 

20 neighborhood (block 210), and the RAD filter function (Eq. 4) is applied to the pixel 
of interest Po (block 212) to generate smoothed digital image data F. 
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For each smoothed pixel of interest 
digital image data I', the hollow neighborhood 
dynamic range and contrast range of the hollo^ 
222), and the contrast stretching operation g(P< 
(block 224). After the sharpening filter has 
sharpened image may be compressed (block 230) 



(bl<j>ck 218, 226, 228) in the smoothed 
of pixels is determined (block 220), a 
neighborhood are determined (block 
') is applied to the pixel of interest P 0 ' 
applied to the digital image, the 



beim 



The system for performing the method 
and 4 may be implemented in hardware, software 
embodiment, the system may be implemented 



of image processing shown in Figs. 1 

or a combination of the two. In one 
n two stages: a first stage for 
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performing selective smoothing and a second stage for performing selective 
sharpening using variable contrast stretching. Figure 7, shows one implementation of 
a system for performing the method of image processing according to Figs. 1 and 4 
including selective smoothing stage 14 couplecjl to selective sharpening stage 15. An 
input device 16 such as a scanner or digital caijiera provides image data I to the 
selective smoothing stage 14 which processes the image data and provides smoothed 
data r to the selective sharpening stage 15 to generate the processed image data I". In 
this embodiment, stages 14 and 15 may be imp lemented as hardware, software, or a 
combination of the two. In an alternative embodiment, stages 14 and 15 are 
implemented by a processing system including a processor and a memory. In this 
implementation, the processor processes the image data received from an input device 
by performing the steps as shown in Figs. 1 an|i 4 according to programming 

i 

instructions. 

It should be noted that although a 3x3 $quare-shaped neighborhood is used 
when performing both selective image smoothing and sharpening, the system and 
method of image processing according to the present invention is not limited to such a 
neighborhood. The neighborhood is not limited to any particular size. The number of 
pixels is not limited to nine. Although a fixed number of pixels in the neighborhood 
is preferred for all pixels of interest, the size of the neighborhood may be changed 
dynamically to accommodate a particular clas$ of image region (e.g., text, graphics, 
natural features). 

The neighborhood is not limited to any particular geometry, although square 
windows are preferred for performance regions. For example, the shape of the 
neighborhood may be diamond shaped. In adc ition, the neighborhood for each of the 
selective smoothing filtering operation and the 
not be the same size. 



selective sharpening operation need 
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Although the method of image processing can provide acceptable 
enhancement and increased compressibility in a single iteration/application of the 
method to the image data, it should be understood that the method of image 
processing can be performed in multiple iterations on the image data. 
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The methods of image .processing shown in Figs. 1 and 4 are not limited to 
documents including both text and natural images. However, it is particularly 
adaptive to image enhancement and compressibility of textual images or combinations 

of textual images, with graphics and natural images . 

I 

Although the method and system of imjage processing has been described in 
connection with grayscale values, it is not so limited. The image processing technique 
may be applied to color images, for example, iinages in RGB color space. In this 
case, the color image is transformed into a human visual system color space such as 
YCbCr color space. Selective smoothing and selective sharpening is then applied 
only to the luminance channel (Y) and the resulting color image can be compressed 
either in the YCbCr color space or in the RGB color space. If it is compressed in the 
YCbCr color space, the transformation from YCbCr back to RGB is avoided. 



In the preceding description, numerous 



specific details are set forth, such as 



specific parameter values or influence functions in order to provide a through 
understanding of the present invention. It will be apparent, however, to one skilled in 
the art that these specific details need not be employed to practice the present 
invention. In other instances, well-known filte ring operations have not been described 
in detail in order to avoid unnecessarily obscuring the present invention. 

In addition, although elements of the present invention have been described in 
conjunction with certain embodiments, it is appreciated that the invention can be 
implement in a variety of other ways. Consequently, it is to be understood that the 
particular embodiments shown and described by way of illustration is in no way 
intended to be considered limiting. Reference to the details of these embodiments is 
not intended to limit the scope of the claims which themselves recited only those 
features regarded as essential to the invention. 



16 



Docket No.: 10006767-1 



